Optimal error tracking via quantum coding and continuous syndrome measurement 
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We revisit a scenario of continuous quantum error detection proposed by Ahn, Doherty and 
Landahl [Phys. Rev. A 65, 042301 (2002)] and construct optimal filters for tracking accumulative 
errors. These filters turn out to be of a canonical form from hybrid control theory; we numerically 
assess their performance for the bit-flip and five-qubit codes. We show that a tight upper bound on 
the stochastic decay of encoded fidelity can be computed from the measurement records. Our results 
provide an informative case study in decoherence suppression with finite-strength measurement. 
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Prospects for quantum computation have motivated the 
development of an extensive theory of quantum error 
prevention/correction (QEC) 1]. Despite experimental 
demonstrations of some key methods 0, 0, U , there re- 
mains a significant gap between the abstract algebraic 
theory of QEC and concrete physical models of real quan- 
tum systems. In particular, QEC is still mainly discussed 
in terms of instantaneous measurement and recovery op- 
erations rather than more realistic continuous-time dy- 
namical models. Bridging this gap would enable us, e.g., 
to deduce limits on QEC performance from the finite 
speed of laboratory measurement and recovery opera- 
tions. Appropriate continuous-time formulations of QEC 
would likewise facilitate deeper connections with control 
theory, which could in turn lead to the discovery of new 
quantum memory schemes. 

Our aim in this article will be to pursue a rigorous 
approach to incorporating finite-strength measurement 
within the familiar conceptual setting of discrete quan- 
tum error correcting codes. At the same time, we will 
arrive at familiar equations from classical control theory 
that should be amenable to characterization via estab- 
lished methods of stochastic analysis. While the specific 
models we consider — continuous-time relaxations of sta- 
bilizer codes as introduced by Ahn, Doherty and Landahl 
[f| — are rather impractical from an experimental point 
of view, they do provide a canonical setting in which to 
demonstrate how essential ideas from quantum error cor- 
rection can be reconciled with stochastic control theory. 
We regard this as an important step towards developing 
a general theory of optimal decoherence suppression with 
resource constraints on measurement and control. 

We begin by considering a continuous-time relaxation 
of the bit-flip code jjj. A logical qubit state = 
Co |0) + ci 1 1) is encoded in the joint state of three physical 
qubits as |W) h-> c |000) + cjlll) = \^ E ). The system 
is coupled to decay channels that can cause independent 
Markovian bit flips and also to probe channels that allow 
for continuous (finite-strength) syndrome measurement 
. Following 0, El , we assume that the syndrome mea- 
surements are constructed by coupling two probe fields 
to the syndrome generators [2| Mi = ZZI = a z ® a z ® 1 



and M 2 = ZIZ = <T z (S)l(S)a z . The total system dynamics 
is then described by the quantum stochastic differential 
equation (e.g. |||) 
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(Mi dA? + M 2 dAf - h.c.) - (§7 + «) dt} U t (1) 

where B\ are the bit-flip channels, A\ are the probe chan- 
nels and X\ — XII = a x ® 1 ® 1, X 2 = IX I et cetera. 
The unitary evolution Ut is a Schrodinger picture prop- 
agator for the entire system including the probe fields. 

For homodyne-type detection of the two probe chan- 
nels we obtain two observation processes Y f l = U}(A\ + 
Aj )Ut that can be written (via quantum R6 rules) as 



dYj = 2y^,UjM l U t dt + dA\ + dA 
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(2) 



(this is called the input-output picture in Simi- 
larly, we could in principle attempt to observe the bit-flip 
events directly by performing direct detection of the cor- 
responding decay channels B\ ; this would give rise to ad- 
ditional (counting) observations Z\ that are independent 
Poisson processes with rate 7 (see, e.g., 9}). Although 
the Z\ are generally assumed to be unobservable in QEC, 
we will exploit them below to obtain useful information 
on the statistics of the measurement currents Y t l . 

Our goal is to detect and to correct bit-flip errors by 
making use of the probe currents Y t l , i = 1,2. Hence we 
must understand how best to extract information about 
error events from the noisy observed signals. We begin 
by calculating the least mean-square estimator for our 
system 0, in the form of a (random) three-qubit den- 
sity matrix p t (the conditional state). For every sys- 
tem observable A, Tr[Ap t ] is the function of the ob- 
servation history that minimizes the estimation error 
((U}AU t - Tr[A Pt }) 2 ). If we observe only Y t \ then p t 
obeys the quantum filtering equation 



fc=i 
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VHH[Mi]p t {dYi - 2y/RTt[MifH\ dt) (3) 
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where T[X]p = XpX^ - p and H[X]p = Xp + pX^ - 
Tr[(X +X')p]p. This is equivalent to the stochastic mas- 
ter equation used in . If we were to additionally observe 
the bit flip channels Z\, we could obtain an improved es- 
timator p t that would obey a "jump-unraveled" version 
of Eq. © with jT[X k ] dt replaced by T[X k ] dZ\. An im- 
portant feature of these equations [9j is that the so-called 
innovations processes dWl — dY£ — Tr[Mipt] dt are 
independent and have the law of a Wiener process. 

We can use the fact that the innovations are Wiener 
processes, in the absence of 'real' (physically generated) 
measurement signals Y t l , to generate the latter through 
Monte Carlo simulations. By driving Eq. with ran- 
dom sample paths of a Wiener process, we can recon- 
struct observation processes Yf that sample the space of 
measurement records with the correct probability mea- 
sure. The evolution of the filter variables in each sim- 
ulation fairly represents what would have happened if 
physically generated measurement records YJ had actu- 
ally been presented to the filter and it derived W% from 
them. Similarly, we can reconstruct Y£ from the jump- 
unraveled version of Eq. @ by driving it with Wiener 
processes W\ and independent Poisson processes Z\ with 
rate 7. The innovations theorem guarantees that both 
simulations will generate sample paths Y t l with the same 
probability measure. We will invoke this property later. 

In the usual setting of discrete quantum codes, an in- 
stantaneous measurement of Mi and M 2 after a period of 
free evolution is used to determine the recovery operation 
(if any) that should be applied. If (Mi,M 2 ) = (+1,+1) 
no correction is necessary; outcomes (—1, +1) mean that 
1X1 should be applied; (+1,-1) =^ I IX and (-1, -1) 
XII. These outcomes are called the error syndromes. In 
the continuous setting we introduce the orthogonal pro- 
jectors ITo . . . 1T3 onto the eigenspaces corresponding to 
each syndrome. The quantity p" L = Tr[II m p t ] is then the 
conditional probability (given the noisy probe observa- 
tions) that, had we actually measured Mi and M 2 , we 
would have obtained the syndrome corresponding to Tl m - 
Plugging p™ into Eq. J2J we obtain the syndrome filter 



_ (a) (b) 

QHr- CO 



dp t = A T p t dt + ^{Hi - hfpt t) Pt {dY? - hfp t dt) (4) 
i=i 

where /i™/2y / K is the outcome of Mi corresponding to 
the syndrome IT m) Hi = diag/i*, and A mn = 7(l-45 mn ). 
The p\ form a closed set of equations, as the observations 
are uninformative on the logical state of the qubit and 
the coherences (if any) between the syndromes. 

The syndrome filter, Eq. Q, is a familiar equation 
from classical probability theory; we will gain important 
insight by reducing our problem to a classical one. Con- 
sider a system that can be in one of four states labeled 
. . . 3. Suppose the system is in some known state at 
time t. After an infinitesimal time increment dt the sys- 
tem can switch to one of the other three states, each 




FIG. 1: Markov chains associated to the three-qubit code: 
(a) the syndrome chain, and (b) the extended correction chain 
with the corresponding syndromes labeled between brackets. 
All transitions are independent with rate 7. (c) A Monte 
Carlo trajectory of max, (pi) (green noisy curve) and Zt (black 
step-like curve) for the five-qubit code with k/T = 100. 

of which occurs with probability 7 dt. This defines a 
Markov jump process on a graph, as depicted in Fig. 
Unfortunately we cannot observe the state directly; in- 
stead, we are given two observation processes of the form 
dY'l = J\ lt dt + dV? where V t 1,2 are two independent 
Wiener processes that corrupt our observations, and m t 
is the state of the Markov jump process at time t. As 
our observations are noisy we cannot know the system 
state with certainty at any time. However, we can calcu- 
late the conditional probability p™ that it is in state m 
at time t. This classical estimation problem is precisely 
solved by Eq. (J3J, known as the Wonham filter lllj. 

To help interpret this result, consider the jump- 
unraveled version of Eq. J3J). In the same way that we 
obtained Eq. |@J, we can substitute = Tr[n m /5 t ] and 
get a closed form expression. Assuming the initial state 
lies inside one of the syndrome spaces 0|, it is read- 
ily verified that [Mi,p t ] — [M 2 ,pt] = for all t and we 
obtain 



dp 
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fc=i 



(5) 



where po is one of the unit vectors = 5 nm . Here X\ 
is a matrix such that X\eo — e\, Xiei — eo, Xie 2 = £3, 
and Xie3 — e 2 , and X 2 ^ are defined similarly as shown 
in Fig. The solution of this equation is of the form 
Pt = e mt where mt is the Markov jump process defined 
above. Since 



dW l t = dYl - hfpt dt = dY t l - h™* dt 



(6) 



must be a Wiener process that is independent from all Z\, 
the statistics of the probe observations obtained from the 



3 



quantum system are precisely described by the classical 
model of the previous paragraph. The Markov process 
n%i is simply the error syndrome obtained by observing 
the bit flips directly, and the Wonham filter above has 
a natural classical interpretation as the best estimate of 
mi given only the noisy probe observations. 

We now turn to the problem of error correction. Sup- 
pose that we let the system evolve for some time while 
propagating the filter Eq. Q with the observations. At 
some time T we pose the question: what operation, if 
any, should we perform on the system to maximize the 
probability of restoring the initial logical state We 
will assume that we can pulse the system sufficiently 
strongly (as compared to k, 7) to perform essentially in- 
stantaneous bit flips on any of the physical qubits. The 
most obvious decision strategy simply mimics discrete 
error correction — given the most likely syndrome state 
to* = argmax m p™, we do nothing if to, = and other- 
wise we perform a bit flip on physical qubit to*. 

But it is possible to do better. Recall that the discrete 
error correction strategy is based on an assumption that 
at most one bit flip occurs in the interval [0, T]. This 
assumption may not hold in practice. With our contin- 
uous syndrome measurement, we do actually have some 
basis for estimating the total number (and kind) of bit 
flips that have occurred. Unfortunately this information 
does not reside in the statistic pt, which only gives the 
conditional probabilities of the syndromes at the current 
time. We are seeking a non-Markovian decision policy 
that knows something about the history of the bit flips. 

The classical machinery introduced above allows us to 
solve this problem optimally. To do this we simply extend 
the Markov jump process m t as shown in Fig. ^d. The 
states of the extended chain m t are no longer the four 
syndromes but the eight error states that may obtain at 
any given time. Every syndrome corresponds to two er- 
ror states, as is shown in Fig. QJd. We still consider the 
same observation processes, so error states that belong 
to the same syndrome give rise to identical observations. 
Thus on the basis of the observations, the two Markov 
chains are indistinguishable. Nonetheless the extended 
chain gives rise to a different estimator that provides pre- 
cisely the information we want. As by construction the 
Wonham filter provides the optimal estimate, we con- 
clude that the optimal solution to our problem is given 
by the Wonham filter for the extended chain, i.e., the 
eight-dimensional equation 

2 

dpt = A T Pt dt hfpt t)p t {dYl - hfp t dt) (7) 

i=i 

where A, hi are the intensity matrix and observation 
vector for the chain rh t (see 0, Q| for details). The 
optimal correction policy is now simple: at time T, we 
perform the correction that corresponds to the state 
to* = argmax m p™. Hence if to* = III we do noth- 



ing, if to* = IXX we flip physical qubits 2 and 3, etc. 
This maximizes the probability of restoring I^b). 

From Fig. ^> we can see how information is lost from 
the quantum memory. At time t = we begin in the no- 
error state III. A bit flip might occur which puts us, e.g., 
in the state XI I, then XIX, etc. But as we are observing 
these changes in white noise there is always a chance that 
when two bit flips happen in rapid succession, we ascribe 
the corresponding observations to a fluctuation in the 
white noise background rather than to the occurrence of 
two bit flips. In essence, successive bit flips are resolvable 
only if they are separated by a sufficiently long interval 
that the filter can average away the white noise fluctua- 
tions (the signal-to-noise 4k determines this timescale). 
Occasionally, multiple bit flips occur too rapidly and in- 
formation is lost (e.g., Ill — > XII — > XIX may be 
mistaken for III — > IX I since the two final states have 
identical syndromes). It is evident from Fig. \\]p that 
this rate of information loss is independent of the error 
state. Hence there is no point in applying corrective bit 
flips at intermediate times t < T, as this cannot slow 
the loss of information. As the Wonham filter is optimal 
by construction, we conclude that the correction policy 
described above is optimal [r?j |. 

How can we quantify the information loss from the sys- 
tem? By construction p* t = max m is the probability 
of correct recovery at time t. Unfortunately, as one can 
see in Fig. the quantity p[ fluctuates rather wildly 
in time. Thus it is not a good measure of the informa- 
tion content of the system, as it is very sensitive to the 
whims of the filter: the filter may respond to fluctua- 
tions in the measurement record by adjusting the state 
as if a bit flip had occurred, but then correct itself when 
it becomes evident that nothing happened. We actually 
want to find some quantity that gives a (sharp) upper 
bound on all future values of p\ . This would truly mea- 
sure the information content of the system, as it bounds 
the probability of correct recovery that can be achieved. 

We claim that the quantity Zt — m ax m (p™/(p™+p™)); 
which is a function of filter variables, provides a suit- 
able measure of the information content at time t. Here 
to 7^ to is the error state that corresponds to the same 
syndrome as m, so p™+p™ = P™ is the probability of the 
syndrome corresponding to to. Hence we can interpret Zt 
as the conditional probability of the error state m, given 
that the system is in the corresponding syndrome. De- 
fine If = pT/(pT +P?) so that 3 t = max m J™. Direct 
application of the ltd rules gives 

Arm pn 

^ = -E A «™^r( / r-/r). (8) 

If we define m£ = argmax m J™, then we get [3 

= _ £ Anm , W (& - /«) < o. (9) 
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FIG. 2: Average decay of 0t for the five-qubit code (depen- 
dence on k/T). These curves indicate upper bounds on the 
performance of a quantum memory based on coding and con- 
tinuous syndrome measurement. 

Hence Zt decreases monotonically, and moreover by con- 
struction we must have p™ < I™, so i>* t < 3t < 3 s for all 
s < t. Thus evidently 3t bounds all future values of p* t . 
One would expect the bound to be tight for sufficiently 
high signal-to- noise (as then P t * will be close to one), 
which is indeed the case as can be seen in Fig. 

The procedure we have outlined can be generalized to 
other stabilizer codes, such as the five-qubit code 0. 
This code protects one logical qubit against single-qubit 
errors by encoding in five physical qubits and measur- 
ing four stabilizer generators. For 'Pauli channel' deco- 
herence described by Lindblad terms J2k=i 7 (T[Xk) + 
T[Yfc] + T[Zk\), the error state graph can be constructed 
by considering all possible assignments of an error state 
€ {/, X, Y, Z} to each qubit and by connecting every pair 
of states that are related by the action of a Pauli opera- 
tor e {X, Y, Z} on one qubit. One thus has a graph with 
4 s = 1024 nodes, with each node connected to 3 x 5 = 15 
other nodes (we have validated this construction by com- 
paring simulations of the corresponding Wonham filter 
with an appropriate stochastic master equation). The 
total error rate is T — I57. Fig. ^ shows a portion of a 
single Monte Carlo simulation of the Wonham filter for 
the five-qubit code; Fig. [21 shows averages of 3t over tens 
of trajectories each for k/T £ {10, 30, 100}. 

In conclusion, we have shown that both the three- and 
five-qubit codes are amenable to a classical analysis in 
terms of Markov jump processes, which enables an opti- 
mal solution of the error tracking problem in continuous 
time. Though the filters that must be propagated for 
this purpose are high-dimensional, the optimal procedure 
gives at least an upper bound on the achievable perfor- 
mance of quantum memories based on coding and finite- 
strength syndrome measurement. In practical situations 
one might not have sufficient resources to propagate the 
full optimal filter, so suboptimal methods are clearly of 
interest. 

One could also consider different control goals. For ex- 
ample, suppose that rather than requiring the state to 
be corrected at time T, we allow ourselves a little more 
time afterwards. This can be helpful; if the syndrome 



has just jumped, but we have not had enough time to 
observe this yet, then we can avoid an incorrect recovery 
by waiting just long enough to observe the jump. This 
can backfire, however, as waiting too long will just cause 
us to lose information. The optimal solution to this prob- 
lem is known as an optimal stopping problem [l2^ | and is 
studied extensively in the mathematical finance litera- 
ture 0| . All of these problems, and many others, are 
subsumed under the title of hybrid control theory. It is 
our hope that this theory will provide important tools 
for the analysis and design of continuous quantum error 
correction codes and suboptimal estimators, and for the 
solution of the associated control problems. 
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